® 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




© Publication number: 0 493 053 A2 



EUROPEAN PATENT APPLICATION 



@ Application number: 91311919.4 
(g) Date of fOing : 23.12.91 



© mt ci. 5 : G06K 1/12, G06K 19/06, 
G06K 15/00 



@) Priority: 27.12.90 US 634990 

@ Date of publication of application : 
01.07.92 Bulletin 92/27 



(g) Designated Contracting States : 
DE FR GB 



@ Applicant : XEROX CORPORATION 
Xerox Square 

Rochester New York 14644 (US) 



@ Inventor : Tow, Robert F. 
951 Maddux Street 
Palo Alto, CA 94303 (US) 

@ Representative : Hill, Cecilia Ann et al 

Rank Xerox Patent Department Albion House, 
55 New Oxford Street 
London WC1A 1BS (GB) 



(§) Method and means for embedding machine readable digital data In halftone Images. 



(§) The present invention provides methods and 
systems for encoding digital data in the angular 
orientation of circularly asymmetric halftone 
dot patterns that are written into the halftone 
cells of digital halftone images. In keeping with 
standard practices, the sizes of these halftone 
dot patterns are modulated in accordance with 
the grayscale data sample values that are pro- 
vided to define the image, so the average ref- 
lectance or transmfttance of each of the 
halftone cells is modulated to provide a more or 
less standard halftone rendering of the image. 
In accordance with this invention, however, 
provision is made for modulating the angular 
orientation of the halftone dot patterns in ac- 
cordance with digital data values, thereby 
embedding the digital data in the halftone inv 
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This invention relates to techniques for embed- 
ding machine readable digital data in halftone images. 

Halftoning is a well-known and widely utilized 
technique for imparting a grayscale appearance to 
dual tone renderings of variably shaded monoo s 
hromatic images (e.g., black and white images) and 
to dual tone color separations of variably shaded 
polychromatic images. It originated as an optical 
analog process for imparting a grayscale appearance 
to dual tone reproductions of continuous tone mono- 10 
chromatic images, but it since has been extended to 
provide digital halftoning processes that can be 
utilized by digital document processors for imparting 
a grayscale appearance to dual tone representations 
of variably shaded, scanned-in digitized images and 15 
to dual tone representations of variably shaded, com- 
puter generated synthetic images. These digitally 
defined images may be monochromatic or polyc- 
hromatic, so it is to be understood that digital halfton- 
ing can be applied for imparting a grayscale 20 
appearance to printed and displayed renderings of 
monochromatic and polychromatic images. Polyc- 
hromatic images typically are halftoned by halftoning 
each of the color separations that are provided for ren- 
dering such images. 25 

Polychromatic imaging (sometimes simply refer- 
red to as "color imaging") is becoming increasingly 
important and commonplace for digital image proces- 
sing applications. It, therefore, is to be understood 
that the present invention also relates to techniques 30 
for embedding digital data in printed and displayed 
renderings of these images, typically by identically 
encoding the data in each of the color separations that 
are provided for rendering them. In other words, the 
encoding process that is used for embedding digital 35 
data in halftoned renderings of polychromatic images 
typically involves multiple iterations of the process 
that is employed for embedding such data in halftoned 
renderings of monochromatic images. Accordingly, in 
the interest of simplifying this disclosure, the following 40 
discussion wfll concentrate on the monochromatic 
case. 

As has been pointed out previously, the functional 
utility of plain paper and other types of hardcopy docu- 
ments can be enhanced significantly if the human 45 
readable information that they normally convey is 
supplemented by adding appropriate machine read- 
able digital data to them. Input scanners can be 
employed for recovering this machine readable data, 
so the data can be employed for various purposes 50 
during the electronic processing of such documents 
and their human readable contents by electronic 
document processing systems, such as electronic 
copiers, text and graphic image processing systems, 
facsimile systems, electronic mafl systems, electronic 55 
file systems, and document and character recognition 
equipment (see, for example, European Patent Appli- 
cations Nos. 0,459,792 and 0.459,793). 



As is known, machine readable digital data can 
be recorded by writing two dimensional marks on a 
recording medium in accordance with a pattern which 
encodes the data either by the presence or absence 
of marks at a sequence of spatial locations or by the 
presence or absence of mark related transitions at 
such locations. The bar-like codes which others have 
proposed for recording digital data on paper utilize 
that type of encoding. See US-A-4,692,603 on "Opti- 
cal Reader for Printed Bit-Encoded Data and Method 
of Reading Same," US-A-4,728,783 and US-A-4,754, 
127 on "Method and Apparatus for Transforming Digi- 
tally Encoded Data into Printed Data Strips," and US- 
A-4,782,221 on "Printed Data Strip Including 
Bit-Encoded Information and Scanner Contrast" 
Another interesting approach is to encode machine 
readable digital data in the shapes of the marks or 
"glyphs" that are written on the recording medium, 
(see European Patent Application No. 91 306 987.8). 

Glyph shape codes have the advantage that they 
can be designed to have a relatively uniform appear- 
ance. For instance, a simple glyph shape code suit- 
ably is composed of small slash- like marks that are 
tilted to the right and left at, say, ± 45° for encoding 
1 's and O's, respectively. However, in some situations 
the more or less uniformly gray appearance of such a 
code may aesthetically objectionable, so there still is 
a need for even less obtrusive codes for encoding 
digital data on hardcopy documents. 

The present invention provides a method and a 
system for encoding digital data in the angular orien- 
tation of circularly asymmetric halftone dot patterns 
that are written into the halftone cells of digital 
halftone images. In keeping with standard practices, 
the sizes of these halftone dot patterns are modulated 
in accordance with the grayscale data sample values 
that are provided to define the image, so the average 
reflectance or transmittance (collectively referred to 
hereinafter as "reflectance" since transmittance is the 
reciprocal of reflectance) of each of the halftone cells 
is modulated to provide a more or less standard 
halftone rendering of the image. In accordance with 
this invention, however, provision is made for mod- 
ulating the angular orientation of the halftone dot pat- 
terns in accordance with digital data values, thereby 
embedding the digital data in the halftone image. 

By way of example only, systems and methods in 
accordance with the invention will be described with 
reference to the attached drawings, in which: 

Fig. 1 is a simplified block diagram of a halftone 
imaging system that embodies the present inven- 
tion; 

Fig. 2 is a diagram of a halftone cell that illustrates 
a suitable fill order for generating circularly asym- 
metric halftone dot patterns that are size modu- 
lated in accordance with grayscale input data 
sample values; 

Figs. 3A - 3C illustrate the discrimination that is 
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provided for encoding digital data values in the 
rotational orientation of the halftone dot pattern 
shown in Fig. 2; 

Fig. 4 is a simplified block diagram that ilustrates 
an alternative technique for superimposing a 5 
pseudo random rotation on the halftone dot pat- 
terns; and 

Fig. 5 is a simplified block diagram that Ilustrates 
a technique for superimposing a pseudo random 
modulation on the halftone image. w 
Turning now especially to Fig. 1, there is shown 
a halftone imaging system 51 for producing halftone 
renderings of scanned-in or computer generated 
synthetic grayscale images. To that end, the imaging 
system 51 comprises a more or less conventional is 
halftone generator 52 for transforming spatially 
periodic grayscale input image sample values into 
halftone dot patterns. In keeping with standard prac- 
tices, these dot patterns are written into a spatially 
periodic two dimensional array of halftone cells for 20 
modulating the average reflectances of the halftone 
cells in accordance with the values of the spatially cor- 
responding grayscale image samples. For example, 
the halftone generator 52 suitably has a table look-up 
memory (not shown) that is addressed by the grays- 25 
cale image sample values to retrieve halftone cells 
that are pre-programmed to contain appropriate 
halftone dot patterns. Thus, as illustrated, the imaging 
system 51 further includes a raster converter 53 for 
converting the programmed halftone cells into a serial 30 
data stream, and a raster printer 54 for tiling the pro- 
gram halftone cells onto a suitable recording medium, 
such as plain paper, in accordance with a raster scan 
pattern. - 

As is conventional, each of the halftone cells is 35 
composed of a two dimensional array of pixels. For 
instance, Fig. 2 illustrates a halftone cell 61 that is 
composed of a 5 x 5 array of pixels. Halftone dot pat- 
terns, such as the hatched pattern shown in Fig. 2, are 
written into the halftone cells by selectively altering 40 
the logical state of certain of their pixels, so that those 
pixels logically contrast with any unaltered or "back- 
ground" pixels. For example, the pixels that define a 
halftone dot pattern may be set to a logical true ("1") 
state if the background pixels are maintained in a logi- 45 
cal false ("0") state. 

A predetermined ffll order is employed for wrffing 
the halftone dot patterns into the halftone cells, 
thereby ensuring that all of the halftone dot patterns 
are continuous patterns (i. e., patterns that are 50 
defined by a single pixel or by a plurality of spatially 
adjacent pixels) that are circularly asymmetric with 
respect to the geometric centers of the halftone cells 
into which they are written. A suitable fill order is given 
in Fig. 2 by the counting numbers that have been 55 
applied to the individual pixels of the halftone ceD 61, 
but this is merely a representative example of a fill 
order for creating continuous, circularly asymmetric 



halftone dot patterns of varying size. 

Focusing in some additional detail on Fig. 2, it will 
be seen that some of the pixels of the halftone cell 61 
are Crosshatch ed to indicate that they are not included 
in the fill order. Instead, these crosshatched pixels are 
set aside to function as dedicated background pixels 
for all of the halftone dot patterns. This has been done 
to maintain the circular assymmetry of the dot pat- 
terns and to simplify the task of discriminating be- 
tween their different permissible angular orientations 
(see the subsequent discussion relating to the 
embedding of digital data into halftone images). Of 
course, the cost of providing these dedicated back- 
ground pixels is that the grayscale resolution of the 
halftone cell 61 is slightly reduced (i. e., from a 
theoretical limit of twenty-six different grayscale 
levels to an actual limit of twenty-four levels in the 
illustrated case), and one extreme (say, the "black" 
extreme) of the grayscale range is slightly truncated. 
However, the human eye has limited high frequency 
resolution and limited grayscale acuity, so the trun- 
cation of the grayscale range and the reduced grays- 
cale resolution may fall below the perceptual 
threshold of casual observers who view the halftone 
images that are produced at a normal viewing dist- 
ance under normal illumination conditions. Indeed, as 
illustrated, the opposite or "white" end of the grays- 
cale range may also be truncated by mandating that 
each halftone cell contain a halftone dot pattern com- 
posed of at least one and preferably two or so pixels 
(a two pixel truncation reduces the grayscale resol- 
ution by two grayscale levels). The advantage of that 
mandate is that it permits the halftone dot patterns to 
function as a self-clocking code for embedding digital 
data in halftone images. Alternatively, to avoid the use 
of dedicated background pixels, the encoded data 
may be confined to one or more predetermined reg- 
ions of a halftone image since conventional image 
processing techniques may be used to identify and 
segment such regions. For example, the data may be 
encoded in the midtones of a face on a "black" back- 
ground, and conventional techniques could then be 
used to identify the spatial extent of the face as a reg- 
ion to be passed as a single entity to the data extrac- 
tion mechnism. Additionally, it is to be understood that 
the spatial periodicity of the halftones could be varied. 

More particularly, the halftone imaging system 51 
of Fig. 1 additionally includes a pattern rotator 71, 
which is coupled between the halftone generator 52 
and the raster converter 53, for modulating the angu- 
lar orientations of the halftone dot patterns in accord- 
ance with a time synchronized series of digital data 
values (supplied by means not shown). As shown in 
Figs 2 and 3A-3C, the angular orientations of the 
halftone dot patterns are modulated by rotating the 
square halftone cells about their geometric centers, 
so up to two bit long binary values may be embedded 
in the halftone images that are produced by employ- 
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ing dot pattern orientations of 0° (Fig. 2), 90° (Fig. 3A), 
1 80° (Fig. 3B), and 270° (Fig. 3C) for encoding the dif- 
ferent values a two bit long binary number may take, 
if desired, however, provision (not shown) could be 
made for modulating the angular orientations of the 5 
halftone dot patterns independently of the halftone 
cells, thereby permitting even longer digital data 
values to be encoded in them. For example, the 
halftone dot patterns could be rotated about the 
geometric centers of the halftone cells in accordance 10 
with respective digital data values, and rotated dot 
patterns could then be mapped or remapped into their 
respective halftone cells. As wfll be appreciated, the 
transformations that are employed for encoding digital 
data in the angular orientations of the halftone dot pat- 15 
terns are conventional affine rotational transfor- 
mations that can be implemented through the use of 
standard techniques for performing such transfor- 
mations. 

The encoding of digital data in the angular orien- 20 
tation of the halftone dot patterns of a halftone image 
may tend to create some undesirable texturing of the 
image. Fortunately, however, this texturing may be 
reduced in a variety of different ways. One way to 
accomplish that is to superimpose a pseudo random 25 
modulation on the rotation of the halftone dot patterns. 
This can be done, as shown in Fig. 1, by providing a 
pseudo random sequence generator 75 for driving the 
pattern rotator 71 with a pseudo random sequence of 
digital values. In that event, the digital data values are 30 
encoded in the rotation of the halftone dot patterns as 
described above, but the angular orientation of the 
halftone dot patterns is additionally modulated in 
accordance with the pseudo random sequence. As 
shown in Fig. 4, a simflar effect can be achieved by 35 
pseudo randomly encoding the digital data values 
prior to applying them to the pattern rotator 71. To 
carry such pseudo random encoding, the digftal data 
values suitably are exclusively bit ORed, by an exclu- 
sive OR gate 77, with a pseudo random sequence of 40 
digftal values that are supplied by a pseudo random 
sequence generator 78. 

The texturing of the halftone images may also be 
reduced by pseudo randomly encoding the grayscale 
input image samples. For that purpose, as shown in 45 
Fig. 5, there is an exclusive OR gate 81 for exclusively 
bit ORing the grayscale image samples with a pseudo 
random sequence of grayscale values that are sup- 
plied by a pseudo random sequence generator 82. 
This approach is, however, distinguishable from the so 
above-described techniques for pseudo randomly 
modulating the angular orientation of the halftone dot 
patterns because the pseudo random encoding of the 
grayscale samples superimposes a pseudo random 
modulation on the halftone image, thereby obscuring 55 
the human readable information content of the image. 
Accordingly, this technique is useful primarily for 
applications in which ft is desired to transmit sensitive 



human readable information via the pseudo randomly 
modulated halftone image. 

Conclusion 

Methods and system for encoding machine read- 
able digital data in halftone images have been des- 
cribed. The circular asymmetry of the size modulated 
halftone dot patterns, which are provided for modulat- 
ing the average reflectances of the halftone cells of 
such an image in accordance with grayscale input 
image samples, enables digital data to be encoded in 
the angular orientation of the halftone dot patterns. 
Furthermore, a supplemental pseudo random modu- 
lation may be superimposed on the angular orien- 
tation and/or the size of the halftone dot patterns. 



Claims 

1. A system for encoding digital data in halftone 
images, said system comprising 

a halftone generator for supplying circu- 
larly asymmetric halftone dot patterns that are 
size modulated in accordance with grayscale 
input image sample values; 

pattern rotating means for angularly orient- 
ing said halftone dot patterns in accordance with 
respective digital data values; and 

output means for writing said angularly 
oriented dot patterns into tiled halftone cells of 
predetermined size on a recording medium for 
producing a halftone rendering of said image with 
said digital data encoded in the angular orien- 
tation of the halftone dot patterns. 

2. A system as claimed in Claim 1 , further including 

means coupled to said pattern rotating 
means for pseudo randomly modulating the 
angular orientation of said halftone dot patterns. 

3. A system as claimed in Claim 1 or Claim 2, includ- 
ing 

pseudo random encoding means for 
pseudo randomly encoding said digital data 
values, thereby superimposing a pseudo random 
modulation on the angular orientation of said 
halftone dot patterns. 

4. A system as claimed in any one of Claims 1 to 3, 
further including 

pseudo random encoding means for 
pseudo randomly encoding said grayscale 
values, thereby superimposing a pseudo random 
modulation on said halftone rendering of said 
image. 

5. A method for encoding digital data in a hardcopy 
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rendering of a halftone image that is defined by 
circularly asymmetric halftone dot patterns of 
varying size; said method comprising the steps of 

rotationally modulating said halftone dot 
patterns in accordance with said digital data; and 5 

writing said rotationally modulated dot pat- 
terns into tiled halftone cells of predetermined 
size on a recording medium, thereby producing 
said hardcopy rendering with said digital data 
encoded therein. 10 

6. A method as claimed in Claim 5, further including 
the step of 

pseudo randomly modulating the rotation 
of said halftone dot patterns. 1 5 

7. A method as claimed in Claim 5 or Claim 6, whe- 
rein 

said digital data values are pseudo ran- 
domly modulated to pseudo randomly modulate 20 
the rotation of said halftone dot patterns. 

8. A method as claimed in any one of Claims 5-7 
further including the steps of 

generating said halftone dot patterns in 25 
response to respective grayscale values, and 

pseudo randomly encoding said grayscale 
values, thereby superimposing a pseudo random 
modulation on said hardcopy rendering of said 
image. 30 
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